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Abstract —In the paper, we investigate the delay-aware data 
transmission in renewable energy aided multi-carrier system. 
Besides utilizing the local renewables, the transmitter can also 
purchase grid power. By scheduling the amount of transmitted 
data (The data are stored in a buffer before transmission), 
the sub-carrier allocation, and the renewable allocation in each 
transmission period, the transmitter aims to minimize the pur¬ 
chasing cost under a buffer delay constraint. By theoretical 
analysis of the formulated stochastic optimization problem, we 
find that transmit the scheduled data through the subcarrier 
with best condition is optimal and greedy renewable energy is 
approximately optimal. Furthermore, based on the theoretical 
derives and Lyapunov optimization, an on-line algorithm, which 
does NOT require future information, is proposed. Numerical 
results illustrate the delay and cost performance of the proposed 
algorithm. In addition, the comparisons with the delay-optimal 
policy and cost-optimal policy are carried out. 

I. Introduction 

With the rapid growth of traffic (e.g., speech, data, video, 
etc.) in wireless communications, the power consumption 
becomes huge, which has incurred severe environmental prob¬ 
lems. Meanwhile, high-rate based new business, such as 
mobile internet, cloud computing, and big data service, make 
the increasing trend for power consumption more apparent. 
Improving energy efficiency has been an important aim in 
communication system designUl. On the other hand, QoS 
guarantee such as delay is also important especially for delay- 
sensitive traffic. Eor example, in real-time multimedia services 
(e.g., video transmission), if a received packet violates its delay 
limit then it is considered useless and must be discarded. Gen¬ 
erally speaking, power saving and QoS (i.e., delay) improve¬ 
ment are two conflicting aspects in wireless communications: 
Reducing power consumption will degrade delay performance, 
and the delay performance improves at the expense of in¬ 
creasing power consumption. Power and delay tradeoff is a 
fundamental problem in wireless communications 121 |f3l . 

Renewable energy has attracted much attention due to its 
naturality, renewable and pollution-free characteristics. Energy 
harvesting technique is capable of converting the renewable 
energy from the environment into electrical energy Q. Re¬ 
cently, incorporating renewable energy in wireless communi¬ 
cations system (or energy harvesting aided wireless communi¬ 


cations) becomes a hot topic in the literature jSl 16) . Meanwhile, 
renewable energy aided base station begins to leak in practical 
cellular mobile communications systems. 

High data rates communications is significantly limited 
by inter-symbol interference (ISI) due to the existence of 
the multiple paths. Multi-carrier modulation techniques, in¬ 
cluding orthogonal frequency division multiplexing (OEDM) 
modulation are considered as the most promising technique 
to combat this problem. Multi-carrier modulation techniques 
(e.g.,OEDM) have been widely selected as the physical layer 
technique in broadband wireless system (e.g., LTE). 

The joint investigation of power and delay in multi-carrier 
communications system has not gained much attention yet, 
especially when local renewable energy is available. In the 
paper, we study the delay constrained power allocation in 
renewable energy aided point-to-point multi-carrier commu¬ 
nications. The transmitter is equipped with renewable energy 
generation device. Meanwhile, the transmitter can purchase 
power from the grid so as to alleviate the renewable energy’s 
intermittence for a stationary minimum QoS guarantee. The 
upper layer of the transmitter generates data stochastically, 
and the data wait in an EIEO (Eirst-In-Eirst-Out) buffer be¬ 
fore transmission. In each period, the transmitter decides the 
number of data for each sub-carrier in the period, and sends 
to the receiver (Meanwhile, the transmitted data are removed 
from the buffer). In addition, the transmitter settles how much 
renewable energy being allocated from the storage battery (and 
the rest required energy is purchased from the grid). The object 
is to minimize the cost under a buffer delay constraint. A 
stochastic optimization problem is formulated accordingly. By 
theoretical analysis, we prove that transmit all scheduled data 
through the best subcarrier in each period is optimal. We give 
the approximate optimal renewable allocation. Eurthermore, an 
on-line algorithm (referred to as BGL algorithm) is proposed 
based on the theoretical results. 

Compared to our previous work 0, the advances of this 
paper lie in two aspects:!) Multi-carrier communication is 
considered, which is vital in ISI alleviation and necessary in 
frequency selective fading channels. 2)An on-line algorithm 
combing our theoretical derives and the Lyapunov optimiza- 
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Fig. 1. Data transmission over multi-carrier system in the presence of 
renewables 


tion is proposed. 

The rest of the paper is structured as follows: In Section HU 
the system model is described, and the stochastic problem is 
formulated accordingly. The analysis of the formulated prob¬ 
lem is performed in Section UII] Next, an on-line algorithm, 
i.e., the BGL algorithm, is proposed in Section HV] Numerical 
results are given in Section |V] Finally, Section |Vl] concludes 
the paper. 

II. System model and problem formulation 

We consider a discrete-time model of point-to-point multi¬ 
carrier wireless communications. Time is divided into periods 
with length r each. The n-th period is the time interval 
[nr, (n-l-l)T) as illustrated in Fig[T] There are M sub-carriers, 
each suffers block flat fading. For a sub-carrier, the channel 
state remains constant during a period and is variable over 
periods. The channel power gain of the i-th sub-carrier during 
the n-th period is denoted as Hi\n]. 

H„ = (iJi[n],-- - ,HM[n]) 

is the channel state vector of the M sub-carriers during the n- 
th period. The transmitter is equipped with renewable energy 
generation device(s), e.g., photovoltaic cells. The renewables 
are stored in a storage battery with capacity B before usage. 
The arrived renewables at the end of the n-th period is 
denoted as E[n\ {E[n] can be understood as the accumulated 
renewables during the n-th period). Meanwhile, the transmitter 
is connected to the power grid, and it can purchase power from 
the grid. The upper layer of the transmitter generates A\n] 
packages at the end of the n-th period iA[n] can be viewed as 
the total generated data during the n-th period). It is assumed 
that each package contains b bits. The generated data are stored 
in an FIFO data buffer. During the n-th period, the transmitter 
removes i?[n] packages from the data buffer, and sends to the 
receiver through the considered M sub-carriers. For the i-th 
sub-carrier, the transmitted data number is i?i[n] during the 
n-th periodf] and i?[n] = '^^e total scheduled 


Rn = (Ri[n],--- ,i?M[n]) 

is the rate vector of the M sub-carriers in the n-th period. 
Denote the data buffer length at instance nr as Q[n]. The 
evolution of the buffer length can be given as 

Q[n + 1] = [Q[n] - R[n])'^ + A[n], (1) 

where (•)+ = max|-,o|. Assume that the additive white 
Gaussian noise at the i-tn subcarrier is with zero mean and 
variance cr^. The consumed power for reliable transmission 
(i.e., error-free according to capacity) of the i-th sub-carrier is 

where 9 = 21n(2)&/L with L being the channel uses in each 
period. The total consumed power during the n-th period is 

M 

P[n]=Y,P,[n]. (3) 

i=l 

In the n-th transmission, the transmitter allocates IF[n] 
power from the storage battery, and other power, i.e., 
max|p[n] — VF[n],o|, is purchased from the power grid. 
That is to say, the purchased grid power in the n-th period is 

Pgr^d[n] = {P[n]-W[n]Y. (4) 

Denote the stored renewables in the battery at instance nr as 
i?b[n]. The evolution of the battery energy is 

Ei,[n -f 1] = min |(i?b[n] — W\n]T)^ + E[n],B'^. (5) 

Denote the grid power price in the n-th period as ^[n], which 
is constant during the n-th period but may change across 
different periods, then the cost of purchasing the grid power 
in the n-th period is 

C[n] = Pgrid[n]i[n] (6) 


The time-average cost over a sufficient large but finite time 
horizon with Uf^nd periods is expressed as 


C = 


1 


E^end 


'^ejid 1 


n—0 


(7) 


For notational simplicity, let Z[n] = (R„,kF[n]) be the 
control action made by the transmitter at the beginning of 
the n-th period. Meanwhile, define 


Z[n] = 


|(R„,IF[n]) R[n] < Q[n],W[n\ < 


Ebjn] j 


as the corresponding action space, fj, is the maximal data 
buffer length. We have the following constrained stochastic 
optimization problem. 


min C = 
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^ The rate is Ri [n] package/period/Hz 


'P^end 


( 8 ) 





































1 


s.t. 


Q = 


^end 


^ Q[n] < 


n—0 


Z[n] G Z[n] 

III. Problem analysis 


(9a) 

(9b) 


Define a policy as tt = • • •) that 7r„ generates action 

Z[n\ = (R„,PP[n]) in the n-th period. In the problem, a 
policy includes the rate vector allocation policy, R( ) (which 
generates R„ in the n-th period), and the renewable allocation 
policy, PP(-)(which generates W[n] in the n-th period) 0 In 
addition, the rate vector policy can be decomposed into two 
aspects; How many packages will be transmitted in each period 
(i.e., the one period rate) and how to allocate these packages 
over M sub-carriers. They are referred to as the rate allocation 
policy R{-) (which generates R[n] in the n-th period) and the 
sub-carrier allocation policy, respectively. 

Intuitively, to reduce the cost given the total data for 
the n-th period transmission, i?[n], all the data should be 
transmitted through the “best” subcarrier for power savings. In 
addition, power should be allocated from the battery as much 
as possible since the renewable energy is free. Formally, the 


one period cost in the n-th period is 
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1) is r; = 


R*[n] = 


R [n], j = arg max 
0, otherwise. 


Since all scheduled data are transmitted through the subcarrier 
with best channel condition, we call the strategy as “best- 
subcarrier” policy. Apparently, the optimal W\n] for mini- 
" -1) - W[n]] + 


mizing 




is allocating the 


ji—1 Hi[n] 

renewable energy as much as possible. And we refer this 
strategy as greedy renewable energy allocation policy. Then, 
we have the following lemma. 


Lemma 2. Given the rate allocation policy R{-), the “best- 
subcarrier” policy is optimal. In contrast, the greedy renew¬ 
able policy is NOT always optimal. 


Proof: See the Appendix. ■ 

Remark: For one period, the “best-subcarrier” policy and the 
greedy policy are optimal sub-policies. Why the optimality 
of “best-subcarrier” policy can be extended from one to 
several periods but the greedy renewable policy can not? 
The reasons are as follows: The variation of the subcarrier 
allocation policy in one period can be thoroughly refiected 
by the one-period cost, and accordingly does not infiuence 
the state of the following period. Then, the optimality for 
one period can be extended to several periods because of the 
independence between two consecutive periods. By contrast, 
the renewable allocation policy in one period will definitely 
affect the state (e.g., Eb) of the following period, furthermore 
the corresponding action. That is to say, the variation of 
the renewable allocation policy in one period can NOT be 
thoroughly refiected by the one-period cost, the effect can be 
“propagated” to the following periods. The independence can 
not hold for the renewable allocation policy. Thus, for greedy 
renewable policy, optimality in each period does not mean 
optimality for several periods. 

Although the greedy renewable policy is NOT strictly 
optimal given the rate policy, it is nearly optimal [|6]. 

Based on the above analysis, we have the following theorem. 


Theorem 1. The (approximately) optimal solution of m, 
{r; ,W*[n]}^^Q can be given as follows: Denote 
Vn := argniin|-^^|, pn ■= ■= 

— l). The optimal rate vector allocation R* = 
• • • , R*M[n]) is given by 


R*[n] 


R*[n],j = Vn 

0, otherwise, 


where R*[n\ is the solution of 


nend-t 

C = [^’(RN)-min{F;6[n],P(i?[n])}] (10) 


Lemma 1. Given the transmitting package number in a 
period, the “best-subcarrier” policy and greedy renewable 
energy allocation policy will be utilized to minimize the one 
period cost. 

We have derived that the “best-subcarrier” policy and the 
greedy policy are the optimal sub-carrier allocation policy 
and optimal renewable energy allocation policy, respectively, 
for one period given transmitting data number. Next, there 
is a natural question “Whether the optimality of the ‘best- 
subcarrier’ & greedy renewable energy allocation policy holds 
for the average cost over several periods given the rate 
allocation policy?” The following lemma reveals the answer. 

^State refers to Hn, Q{n], Ei,[n] and ^[n]; control action is generated 
according to state under policy 


^ r Q<M, (lla) 

■ I R[n] < Q[n]. (11b) 

The approximately optimal renewable allocation FF*[n] = 
P{R*[n]) — min{i?f,[n], P(i?*[n])}. 

Proof: The theorem can be verified by the first half of 
Lemma|2]and the approximate optimality of greedy renewable 
allocation|0. The detailed proof is omitted for brevity. ■ 

IV. On-line algorithm 

In many scenarios, the future information is unavailable. 
We need to make decisions according to current (and past) 
information (on-line decision). In this section, we propose an 
on-line algorithm “Best-Greedy-Lyapunov” (BGL algorithm) 
(in Table |I]i based on Theorem [T] and recently developed 
Lyapunov optimization Q. 











TABLE I 


Algorithm: BGL algorithm 


the optimal solution is R* [n] = i?J^nd the corresponding ob- 
ject value is < 

If Rfs < Rfh, R*\n] = Rth and the corresponding 
: > Q n] 


Step 1: At the beginning of every period n, observe the current state including ® W 

current environment information (i.e., and ^[n]), current data queue lengtlpbject value is ^ Q['fT]Rth) ■ If 
Q[n], and current battery energy queue length E^ln 
Step 2: Choose R[n] E [0,Q[n]] to minimize 


and the corresponding object value is V 


, R*[n] 

(gSQh 


= Q[n] 


V- 


( 12 ) 


IS a constant. 


[tin - 1) - W[n]] ^[n] - Q[n]R[n] 

where W{n] = ram^Ei,[n],riri{e^^^"^ — l)|-, and V > 0 
Step 3: Denote the selected il[n] in step 2 as i?*[n]. Choose the optimal W[n] as 
VL* [n] = min | E), [n], tin (e®^* — l) | 

Step 4: Update Q[tt] and E},{n] according to (I) and respectively. Rpmnrk ■ 


Eb\n] ^[n] — Q[n]Q[n] < —Q[n]Rth- In conclusion. 


Rs, R. 


e [Rth,Q[n]] 

R*\n\ = ( Rth,Rs < Rth 
Q[n\,Rs > Q[n\ 


(16) 


The proposed BGL algorithm is purely an on-line algorithm, 
which requires only the current system state. In the algorithm, 
we only need to solve a simplified deterministic optimization 
problem, (fTSl i. 

First, we analyze the effect of parameter V on the data 
transmission qualitatively (or semi-quantitatively). In step 2, 
V > 0 is some constant to tradeoff the cost and queue length 
(i.e., delay). Specifically, given a small value of V, queue 
length is the focus. Then we transmit as much data as possible, 
R[n] = Q[n]. That is to say, we trade cost for delay. For 
large V, the reducing the cost is dominant, then we do NOT 
purchase power from the grid and only part (NOT always all) 
of the buffer data will be transmitted. That is to say, we trade 
delay performance for cost. 

Until now, we have not exactly answer “How much data 
will be transmitted in each period?” Next, we investigate 
the problem quantitatively. That is to say, we concentrate on 
finding the optimal solution of (fTSl i mathematically to give the 
answer. 

If 

• Eb[n] 


Rth ■- 

0 I r]n J 


(fTSl l is reduced to 


min — 

0<fl[n]<Q[n] 


(13) 


Rth is the maximal packet number that can be 
transmitted when using the stored renewable energy only. 
Rth > Q[n] means that the stored renewables can support 
transmitting all the buffer data. Based on Theorem [T] trans¬ 
mitting all the buffer data is optimal in this scenario. That is 
to say, R*[n] = Q[n]. On the other hand, when Rth < Q[n], 
the renewables can NOT support emptying the data buffer, 
i.e., we may need purchasing power from grid in this case; If 
Rs < Rth (e.g., V is large), cost is the key factor. We transmit 
Rth packages only using the renewables and no grid power 
will be purchased. We trade the delay for cost decrease. If 
Rs > Q[n] (e.g., V is small), the delay requirement is sharp. 
Together with the renewables, we purchase the deficient power 
from power grid to empty the data buffer. We trade cost for 
delay performance. The third scenario, Rg € [RtbiQin]], both 
the cost and delay are important, we can NOT trade one totally 
for the other. Besides the renewables, we buy some grid power 
for transmitting Rg packages (NOT all buffer data). 

V. Numerical results 

In this section, simulations are carried out to illustrate 
the performance of the BGL algorithm. First, the simulation 
settings are given. Next, we show the delay and cost per¬ 
formance of BGL algorithm. Third, we compare the BGL 
algorithm against two other algorithms (i.e., DOP policy and 
COP policy) explained later. 

A. Simulation setup 


Thus, the optimal solution is R*[n] = Q[n]. Otherwise, if 
Rth < Q[n], (HJI becomes 


min V ■ 

Rth<R[n\<Q[n\ 



l)-Et,[n] 


^[n] - Q[n]R[n] 


combined with 


min —Q[n]R[n]. (15) 

0<R[n\<Rth 

The optimal solution of ( fTSl l is R*[n] = Rth, and correspond¬ 
ing object value is ( — For (fT4l i. if 


In the simulations, 3 sub-carriers are considered, i.e., M = 
3, and we set r = 1, 6 = 1, N = 5, = 1. We 

consider Rayleigh fading in each sub-channel. That is to 
say, the power gain of each sub-channel is exponentially dis¬ 
tributed. It is assumed that the 3 sub-channels have same mean 
'-^^ower gain. The data arrival is i.i.d., and the arrived package 
number in each period chooses 0,10, 20, 30 with probability 
0.1, 0.5, 0.3, 0.1, respectively. The renewable energy arrives 
i.i.d.il, and the arrived renewable energy in each period is 
100,300,500,800 with probability 0.1, 0.6, 0.2,0.1, respec¬ 
tively. The grid power price is 0.02 and 0.05 with probability 
0.3 and 0.7, respectively. The performance is averaged over 
Rend = 10® periods. 


, 1 Q[n] 

■ 0 


G [Rth,Q[n]], 


^Rs is the stationary point of the object function in o. 
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B. Delay and cost performance of BGL algorithm 

Fig. m plots the average delay and corresponding cost 
performance of the BGL algorithm with respect to V under 
different battery capacities. The mean power gain is set as 
0.3. We consider two battery capacities D = 2500 and 
B = 1000. We can see that with the increase of V, the 
data buffer length increases at hrst, and then remains static. 
Meanwhile, the cost decreases to zero and remains as zero 
then. It can be explained as follows: V is the trade-off factor. 
When increase V, the “importance” of cost increases and 
the “importance” of delay decreases (See (O). The BGL 
algorithm trades the delay performance degradation for the 
cost decrease. Mathematically, when V increases, according 
to (fThl l. the average transmitted package number decreases 
at hrst. Given the mean data arrival and renewable energy 
arrival, less transmitted data results in longer average data 
buffer length and less average cost. Hence the data buffer 
length increases and the cost decreases. When V is very 
large, Rs < Rth satishes almost always, then according to 
(O, the transmitted package number remains as Rth- The 
average buffer data length remains static given mean data 
arrival. Furthermore, the renewable energy can support Rth 
and no grid power needs purchasing. Thus, the cost remains 
as zero. In addition, by comparing the two lines of B = 2500 
and B = 1000 in each sub-hgure, we can hnd that larger 
battery capacity improves the delay and cost performance. This 
is evident since larger capacity stores more (at least no less) 
renewables and leads to more data transmission and/or less 
cost. 

Fig. [3 illustrates the delay and corresponding cost perfor¬ 
mance of BGL algorithm versus the mean power gain under 
different V. The battery capacity B = 2500. It is observed 
that the buffer length and cost decrease when the channel 
condition improves (i.e., increase of mean power gain) at hrst, 
and remains static then. The reason is as follows: When the 
channel condition improves, the same amount energy supports 
more data transmission (See Q). Given the mean data arrival, 
the average data buffer length decreases. Given the mean 
renewable arrival, the cost decreases. By comparing the lines 
of different V, we can also hnd that larger V leads to longer 
buffer length and less cost. The explanation is same as in Fig. 

H 

C. Algorithm comparison 

In this subsection, we compare the BGL algorithm against 
two other algorithms described as follows: 

• Delay-optimal policy (DOP): In each period, the transmit¬ 
ter sends all the buffer data through the best sub-carrier, 
and utilizes the renewable energy as much as possible. 
Formally, 

Q[n],j = Vn 

0, otherwise; 

lL[n] =min{£;b[n],?7„(e«'3N - l)}. 

• Cost-optimal policy (COP): In each period, utilize the 
renewables only to transmit data as much as possible 



^^0 20 40 60 80 100 

V 
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through the best sub-carrier, and no grid power is pur¬ 
chased. That is to say, the cost is zero. Formally, 

uim{Q[n],Rth},j = Vn 

0, otherwise; 

W[n] = min — l)|. 

Fig. |4] shows the comparisons of delay and corresponding 
cost, respectively, for BGL algorithm against DOP policy as 
well as COP policy. The mean power gain is 0.3, and the 
battery capacity is = 2500. With the increase of V, the BGL 
algorithm reaches the COP policy both in delay and cost. On 
the contrary, when decrease V, the BGL algorithm approaches 
the DOP policy. In terms of performance, the BGL policy can 
be viewed as a “mixed” policy of DOP and COP. By adjusting 
V, the delay and cost can be traded off. BGL algorithm with 
varying V can be applied as follows: Considering a constraint 
on delay (i.e., a value of p), we can get the maximal V from 
Fig. |4(a)| Then we get the optimal cost from |4(b)| 

VI. Conclusion 

Delay-constrained data transmission in multi-carrier com¬ 
munication is studied in the presence of local renewable 























Fig. 3. The performance of BGL algorithm versus mean power gain 


energy. We formulate a stochastic constrained optimization 
problem. By theoretical analysis, we derive that transmit data 
thorough the best sub-carrier is optimal, and greedy renewable 
allocation is nearly optimal. Additionally utilizing Lyapunov 
optimization, the BGL algorithm is proposed. Using a tradeoff 
factor, the cost and delay performance can be adjusted in the 
BGL algorithm. In the end, simulations show the effectiveness 
and advance of the BGL algorithm. 

Appendix 
Proof of Lemma|2] 

First, the optimality of the “best-subcarrier” policy can be 
verified by contradiction. Suppose that an optimal policy of 
the problem ( fTOb does not utilize “best-subcarrier” policy as 
its subcatrier allocation policy. Consider a period, e.g., the i-th 
period, since R{-) is given, i?[i] is fixed, and is not transmitted 
totally through the best subcarrier. Now let a “novel” policy 
that transmit all the i?[z] data through the best subcatrier and 
keep others same as the supposed optimal policy. Then there 
will be some power savings, and the cost in the Lth period 
will be not more. Meanwhile the delay is the same. As the 



(a) Comparison of delay performance 



(b) Comparison of cost 

Fig. 4. The performance comparison against DOP and COP 

“novel” policy only changes the sub-carrier allocation, it will 
not change the beginning state of the following periods. In 
this sense, the periods are independent, i.e., for the following 
periods, the cost under the “novel” policy for each period is 
not more and delay is the same (Note that the novel policy is 
feasible) compared to the supposed optimal policy. As Uend 
is sufficiently large, there is at least one period, the cost is 
less0 Hence the average cost is less (Observe that Uend is 
finite). This contradicts with the assumption. The proof of the 
optimality of the “best-subcarrier” policy completes. 

Second, the Lagrange relaxed problem of (fTol) (with multi¬ 
plier A > 0) can be expressed as 

1 '^end 1 

min C = - C[n] + AQ[n] (17) 

{^N}^iV”^•^Ne2N '^end 

The optimal renewable energy allocation policy of (fTOl) must 
be optimal for (fTTl l. In other word, if we can prove that the 
greedy renewable policy is not optimal for (fTTl) . then we prove 

the transmitter purchases from the power grid in a period under the 
supposed optimal policy, then in this period, the “novel” policy produces less 
cost. 































that the greedy renewable policy is not optimal for (fTOl i. The 
non-optimality of the greedy renewable policy for ([TtT i can 
be verified similarly as the proof of Lemma 10 in |[6l. Then 
the proof of the greedy renewable policy’s non-optimality 
completes. 
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